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Abstract 

A discrepancy principle for solving nonlinear equations with monotone operators 
given noisy data is formulated. The existence and uniqueness of the corresponding 
regularization parameter a{d) is proved. Convergence of the solution obtained by the 
discrepancy principle is justified. The results are obtained under natural assumptions 
on the nonlinear operator. 
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1 Introduction 

Consider the equation: 

F{^) = f, (1) 

where F is a monotone operator in a real Hilbert space H. Monotonicity is understood in 
the following sense: 

{F{u) - F{v),u-v) >0, yu,veH. (2) 

Here (•, •) denotes the inner product in H. Assume that F is continuous. 

Equations with monotone operators are important in many applications and were 
studied extensively, see, for example, [I]-[3], [9], [10], [T2], and references therein. There 
are many technical and physical problems leading to equations with such operators in the 
cases when dissipation of energy occurs. For example, in [5] and [1], Chapter 3, pp. 156- 
189, a wide class of nonlinear dissipative systems is studied, and the basic equations of 
such systems can be reduced to equation (1) with monotone operators. Many examples of 
equations with monotone operators can be found in [2j and in references mentioned above. 
In [6] and [7] it is proved that any solvable linear operator equation with a closed densely 
defined operator in a Hilbert space H can be reduced to an equation with a monotone 
operator and solved by a convergent iterative process. 
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In this paper, apparently for the first time, a discrepancy principle for solving equation 
([3]) with noisy data (see Section 2) is proved under natural assumptions. No smallness 
assumptions on the nonlinearity, no global restrictions on its growth, or other special 
properties of the nonlinearity, except the monotonicity and continuity, are imposed. No 
source-type assumptions are used. Our result is widely applicable. It is well known that 
without extra assumptions, usually source- type assumption concerning the right-hand side, 
or some equivalent assumption concerning the smoothness of the solution, one cannot get 
a rate of convergence even for linear ill-posed equations (see, for example, [9]). On the 
other hand, such assumptions are usually not algorithmically verifiable and often they do 
not hold. By this reason we do not make such assumptions and do not give estimates of 
the rate of convergence. 

In [11] a stationary equation F{u) = f with a nonlinear monotone operator F was 
studied. The assumptions A1-A3 on p. 197 in [TT] are more restrictive than ours, and the 
Rule R2 on p. 199, formula (4.1) in [llj, for the choice of the regularization parameter is 
more difficult to use computationally: one has to solve nonlinear equation (4.1) in [11] 
for the regularization parameter. Moreover, to use this equation one has to invert an 
ill-conditioned linear operator A + al for small values of a. Assumption Al in [11] is not 
verifiable, because the solution is not known. Assumption A3 in [TT] requires F to be 
constant in a ball Br{x^) if F'{x^) = 0. Our discrepancy principle does not require these 
assumptions, and, in contrast to equation (4.1) in [TT], it does not require inversion of 
ill-conditioned linear operators. 

The novel results in our paper include Theorem [5] in Section [3] and Theorem [7] in 
Section m In Theorem [5] a new discrepancy principle is proposed and justified assuming 
only the monotonicity and continuity of F. Implementing the discrepancy principle in 
Theorem [5] requires solving equation ([3]) and then solving nonlinear equation (jlSp for 
the regularization parameter a{5). Theorem [7] allows one to solve equations ^ and 
approximately. Thus, when 5 is not too small one can save a large amount of computations 
in solving equations ([3]) and (jlSp by applying Theorem [7] and using our new stopping rule. 
Our results allow one to solve numerically stably equation ([T]) if F is locally Lipschitz 
and monotone. Based on Theorem [71 an algorithm for stable solution of equation ([1]) is 
formulated for locally Lipschitz monotone operators. 

2 Auxiliary results 

Let us consider the following equation 



where a = const. It is known (see, e.g., [9l p. Ill]) that equation ([3]) with monotone 
continuous operator F has a unique solution for any fs G H. 

Throughout the paper we assume that F is a monotone continuous operator and the 
inner product in H is denoted {u, v). Below the word decreasing means strictly decreasing 
and increasing means strictly increasing. 

Recall the following result from [9, p. 112]: 




a > 



(3) 
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Lemma 1 Assume that equation ([T]) is solvable, y is its minimal-norm solution, assump- 
tion ([2]) holds, and F is continuous. Then 

lim||T4-y|| =0, (4) 

a— >0 

where Va solves equation ^ with (5 = 0. 

Lemma 2 Assume |ji^(0) — > 0. Let a > 0, and F he monotone. Denote 

i,{a) := \\Vs,al m := aV^(a) = 11^(^5,,) - fsl 
where V^^a solves Then ip{a) is decreasing, and (j){a) is increasing. 



Proof. Since ||F(0) - > 0, one has ipia) / 0, Va > 0. Indeed, if = 0, then 

Vs^a = 0, and equation ([3]) imphes ||-F(0) — fs\\ = 0, which is a contradiction. Note that 
(f){a) = a\\Vs^a\\- One has 

< {F{Vs,a) - F{Vs,b), Vs,a - Vs,b) 
= {-aVs,a + bVs,b, V5,a - Vs,b) (5) 
= (a + b){Vs,a, Vs,b) - a\\VsJ^ - b\\Vs4^. 

Thus, 

< (a + b){Vs,a, Vs,b) - a\\Vs,af - b\\Vs,bf 
< {a + b)\\VsJ\\Vs,b\\-a\\Vs,af -b\\Vs4' 
= {a\\Vs,a\\-b\\Vs4){\\Vs4-\\VsJ) 

= {^{a)-^{b)){i;{a)-m)- 

If ilj{h) > -0(0) then ([6]) imphes (j){a) > (j){b), so 

aV'(a) > 6^(6) > bip{a). 

Therefore, if ip{b) > ip{a) then b < a. 

Similarly, if < V'('^) then (/>(a) < </>(6). This implies b > a. 
Suppose ijjia) = il^{b), i.e., IjKs^all = liKs.fell- From ([5]) one has 

Ws^af < {Vs,a,Vs,b) < \\Vs,a\\\\Vs,b\\ = \\Vs,a 



(6) 
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This implies Vs^a = ^5,6) and then equation ^ implies a = b. 

Therefore 4> is increasing and ip is decreasing. □ 

Lemma 3 If F is monotone and continuous, then \\Vs^a\\ = 0{^) as a ^ 00, and 

hm \\F{Vs,a)-f5\\ = \\F{0)-fs\\. (7) 
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Proof. Rewrite ([3]) as 

F{Vs,a) - F{0) + aVs,a + F{0) - fs = 0- 
Multiply this equation by Vs^a, use the monotonicity of F and get: 

a\\Vs,af < {aVs,a + F{Vs,a) - F{0),Vs,a) = {fs - F(0), Vs,a) < \\h - Fm\\\VsJ. 
Therefore, HV^^all = O(^). This and the continuity of F imply ([7]). □ 
Remark 1 If |1F(0) - fs\\ > C5'^,0 < 7 < 1 then relation ([Tj) implies 

\\FiVs,a)-fs\\>C6\ 0<7<1, (8) 
for sufficiently large a > 0. 

Lemma 4 Let C > and 7 € (0, 1] be constants such that C6^ > 6. Suppose that 
||F(0) — > C6^ . Then, there exists a unique a{6) > such that \\F{Vs^a{5)) — fs\\ = Cd'^ . 

Proof. We have F{y) = f, and 

={F{V5,a) + aVs,a - f5,F{Vs,a) " fs) 

= \\F{Vs,a) - fsf + a{Vs,a - y,F{Vs,a) - fs) + a{y,F{Vs,a) - fs) 
= \\F{Vs,a) - fsf + a{Vs,a - y,F{Vs,a) - F{y)) + a{Vs,a -yj- fs) 
+ a{y,F{Vs,,)- fs) 

>\\F{Vs,a) - fsf + a{Vs,a -yj-fs) + a{y, F{Vs,a) - fs). 
Here the monotonicity of F was used. Therefore 

\\F{Vs,a) - fsf < -a{Vs,a -yj-fs)- a{y, F{Vs,a) - fs) 

< a\\Vs,a - y\\ 11/ - Ml + a\\y\\\\F{Vs,a) - fs\\ (9) 
<a5\\Vs,a-y\\+a\\y\\\\F{Vs,a)- fs\\. 

Also, 

= {F{Vs,a) - F{y) + aVs,a + f - fs, ^5,a - y) 
= {F{Vs,a) - F{y), Vs,a -y) + a\\Vs,a - yf + a{y, Vs,a -y) + {f- fs, Vs,a - y) 

> a\\Vs,a - yf + a{y, Vs,a -y) + if - fs, Vs,a - y), 

where the monotonicity of F was used again. Therefore, 

a\\Vs,a - yf < a\\y\\\\Vs,a - y\\ +^\\Vs,a - y\\- 

This implies 

a\\Vs,a - y\\ < a\\y\\ + 6. (10) 
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From Q, (fTUj) . and an elementary inequality ab < ea} + ^, Ve > 0, one gets: 

\\F{y&,a) - Ml' < 5' + a\\y\\b + a||y|| 11^(^5,,) - f^\\ 

< ^2 + a\\y\\b + e||F(y5,a) - /^f + ^a'llyf , ^^^^ 

where e > is arbitrary small, fixed, independent of a, and can be chosen arbitrary small. 
Let a \ 0. Then ^ implies lima^o(l - e)||F(V5,a) - f&\? < 5'^ < {CS'^f. Thus, 

\\m\\F{ys,a)- f6\\<C5\ C>0, 0<7<1. 

This, the continuity of F, the continuity of V^^a with respect to a € [0, oo), and inequality 
([8]), imply that equation ||-F(V5^a) — fs\\ = C5^ must have a solution a{5) > 0. □ 

Remark 2 Let Va ■= Vs^a\5=0i so F{Va)+aV — f = 0. Let y be the minimal-norm solution 
to equation ([T]). We claim that 

\\V5,a - VaW < -. (12) 

a 

Indeed, from ([3]) one gets 

F{Vs,a) - F{Va) + a{Vs,a " = / " fs- 

Multiply this equality by {Vs^a — ^a) and use ([2]) to obtain 

6\\Vs,a-Va\\ > if - fs,Vs,a-Va) 

= {F{Vs,a) - F{Va) + a{Vs,a " K), 1^5,a " K)) 
>a\\V8,a-Vaf- 

This implies p2p. 

Let us derive a uniform with respect to a bound on ||V^||. From the equation 

F{Va) + aVa - F{y) = 0, 
and the monotonicity of F one gets 

= {F{Va) + aVa - F{y), Va - y) > a(K, Va-y). 
This implies the desired bound: 

IIKII < ||y||, Va>0. (13) 

Similar arguments one can find in [9, p. 113]. 

From ()12p and (I13p . one gets the following estimate: 

ll^vll < IIK|| + -< ||y|| + -. (14) 

a a 
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3 A discrepancy principle 

Our standing assumptions are the monotonicity and continuity of F and the solvabihty 
of equation ([T]). They are not repeated below. We assume without loss of generality that 
(5G (0,1). 

Theorem 5 Let 7 G (0, 1] and C > be some constants such that C6'^ > 6. Assume 
that ll-F(O) — > C6^ . Let y be its minimal-norm solution. Then there exists a unique 
a{5) > such that 

\\F{Vs,ais))-f5\\=C5\ (15) 

where Vs^a{S) solves ([3|) with a = a{5). 
// < 7 < 1 then 

lim ll^5,a(5) - y|| = 0- (16) 
0— >o 

Proof. The existence and uniqueness of a{5) follow from Lemma [H Let us show that 

lima((5)=0. (17) 

The triangle inequality, inequality (fT2]) and equality imply 

a{6)\\V,^S)\\ < a{S){\\Vs,aiS) " + \\Vs,a(S)\\) .^g. 

<5 + ai5)\\Vs,a(s)\\=S + CS\ 



From inequality (fT8|l . one gets 



lima(5)||K(5)|| = 0. (19) 
0— >u 



It follows from Lemma [2] with fs = f, i.e., 6 = 0, that the function (poio-) ■= o,\\Va\\ is 
nonnegative and strictly increasing on (0, 00). This and relation ()19p imply: 

lim a(6) = 0. (20) 

From (fT5]) and (fT4ll . one gets 

C5^ = a\\VsJ<ai5)\\y\\+5. (21) 

Thus, one gets: 

CS'^ - 6 < a{5)\\y\\. (22) 
If 7 < 1 then C — 6^^'^ > for sufficiently small 6. This implies: 

< lim — - < lim ^ = 0. (23) 



By the triangle inequality and inequality p2|) . one has 

\\yS,a(S) - y\\ ^ \\^a{S) - y\\ + WVaiS) " ^5,a(5)ll < I|K(5) " ^11 + (24) 

Relation ([16]) follows from ([23]), ^ and Lemma E □ 
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Instead of using one may use the following equation: 

F{Vs,a) + a{Vs,a -u)-fs = 0, a > 0, (25) 

where u is an element of H. Denote Fi{u) := F{u + u). Then Fi is monotone and 
continuous. Equation ([3]) can be written as: 

Fi{Us,a) + aUs,a - fs = 0, Us,a:=Vs,a-u, a > 0. (26) 

By applying Theorem [5] with F = Fi one gets the following result: 

Corollary 6 Let 7 G (0, 1] and C > be some constants such that CS"' > 5. Let u € H 
and z be the solution to ([T]) with minimal distance to u. Assume that \\F{u) — fs\\ > C6^ . 
Then there exists a unique a{6) > such that 

\\F{Vs,aiS))-f5\\=CP, (27) 
where Vs^a{5) solves the following equation: 

F{Vs,a) + a{6){Vs,a - u) - fs = 0- 
If J & (0, 1) then this a{6) satisfies 

lim\\Vs,ai6) - 4 = 0. (28) 

Remark 3 It is an open problem to choose 7 and C optimal in some sense. 

Remark 4 Theorem [5] and Theorem [7] do not hold, in general, for 7 = 1. Indeed, let 
Fu = {u,p)p, \\p = p A. AA(F) := {u G H : Fu = 0}, f = p, fs = p + q5, where 
(P) q) = Oi Ikll = 1) Fq = 0, \\q5\\ = 6. One has Fy = p, where y = p, is the minimal-norm 
solution to the equation Fu = p. Equation Fu + au = p + q5, has the unique solution 
Vs,a = qS/a + p/{l + a). Equation (fT5]) is C6 = \\q5 + (ap)/(l + a)\\. This equation 
yields a = a{6) = c6/{l — c6), where c := (C^ — 1)"^^^, and we assume c5 < 1. Thus, 
lim^^o ^S,a(S) = P + c~^q := v, and Fv = p. Therefore v = lim^^o ^5,a(5) is ^ot p, i.e., is 
not the minimal-norm solution to the equation Fu = p. Similar arguments one can find 
in [g p. 29]. 

4 Applications 

In this section we discuss methods for solving equations ([3]) and ([T]) using the new discrep- 
ancy principle, i.e., Theorem [5j Implementing this principle, i.e., solving equation (jlSp . 
requires solving equation ([3]). If F is linear, then equation ([3]) has the form: 

(F + al)u = fs. (29) 

Since F >0 the operator F-|-a/ is boundedly invertible, ||(F-|-aI)~^|j < and equation 
(j29p is well-posed if o > is not too small. There are many methods for solving efficiently 



7 



well-posed linear equations with positive-definite operators. For this reason we mainly 
discuss some methods for stable solution of equation ([1]) with nonlinear operators. In this 
section a method is developed for a stable solution of equation ([T]) with locally Lipschitz 
monotone operator F, so we assume that 

\\F{u) - F{v)\\ < L\\u-v\\, u,v £ B{uo,R) := {u:\\u-Uo\\ < R}, L = L{R). (30) 

Here uq £ H is an arbitrary fixed element. Consider the operator 

G{u):=u-\[F{u) + au- fs], A > 0. 

We claim that G is a contraction mapping in H provided that A is sufficiently small. Let 
Fi := F + al. Then (|30p implies \\Fi{u) — Fi{v)\\ < {a + L)\\u — v\\. Using the monotonicity 
of F, one gets 

\\G{u) - G{v)f = \\{u-v)- A(Fi(n) - Fi{v)) f 

= \\u - vf - 2X{u - V, Fi{u) - Fi{v)) + X^\\Fi{u) - Fi{v)f (31) 
< \\u - vf[l - 2Xa + X^{a + if]. 

This implies that G is a contraction mapping if 

2a 

< A < 



(a + L)2- 

For these A the solution Vs^a of equation ([3]) can be found by the following iterative process: 

Un+l =Un- X[F{Un) + aUn - fs], UQ ■= UQ- (32) 

After finding Vs^ai one finds a{6) from the discrepancy principle (fTSll . i.e., by solving the 
nonlinear equation: 

^{ai6)) := \\F{Vs,,^S)) - fsW = C6\ (33) 

There are many methods for solving this equation. For example, one can use the bisection 
method or the golden section method. If a(6) is found, one solves equation ([3]) with 
a = a{6) for Vs^a(5) and takes its solution as an approximate solution to ([1]). 

Although the sequence Un , defined by ([32]) , converges to the solution of equation ^ at 
the rate of a geometrical series with a denominator q € (0, 1), it is very time consuming to 
try to solve equation ([3|) with high accuracy if q is close to 1. Theorem [7] (see below) allows 
one to stop iterations (|32p at the first value of n which satisfies the following condition: 



\\F{un) + aUn- fs\\<95, e>0, (34) 
where is a fixed constant. This saves the time of computation. 

Theorem 7 Let 6, F, fs, and y be as in Theorem\^ and < 7 < 1. Assume that vs € H 
and a{6) > satisfy the following conditions: 

\\F{vs) + a{6)vs - Ml < 65, 6 > 0, (35) 
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and 

Ci6^ < \\F{vs) - fsW < C25\ < Ci < C2. (36) 

Then one has: 

lim \\vs — y\\ = 0. (37) 

Proof. Let u and v be arbitrary elements in H. By the monotonicity of F one gets 

a\\u — v\\^ < {u — V, F{u) — F{v) + au — av) ^^^^ 
< \\u — v\\\\F{u) — F[v) + au — av\\, Va > 0. 

This imphes 

a\\u - v\\ < \\F{u) - F{v) + au - av\\, \/v,ueH, Va > 0. (39) 

Using inequahty (f39j) with v = vs and u = Vs,a{5)j equation ([3]) with a = a{5), and 
inequahty ([35]) . one gets 

(40) 



a{6)\\vs - Vs^a{S)\\ < \\F{vs) - F{Vs^a(5)) + oi{6)vs - a{6)Vs^a{S)\ 
= \\F{vs) + a{d)vs- fsW <06. 



Therefore, 

IK-V,„||<^. (41) 

Using (fn|) and ([iT]) . one gets: 

a{6)\\vs\\ < a{5)\\Vs,^(^s)\\ + a{S)\\vs-Vs,o,^s)\\ < 96 + a{5)\\y\\ + 5. (42) 
From the triangle inequality and inequalities (j35p and (|36|) one obtains: 

a('^)lb5|| >||F(^'^)-M|-||i^(^;^) + a(<5)^;^-M| >Ci5^-05. (43) 
Inequalities and imply 

Ci(5^-0(5<e5 + a(5)||?/|| +5. (44) 

This inequality and the fact that Ci — 6^~'^ — 296^^^^ > for sufficiently small 6 and 
< 7 < 1 imply 

Thus, one obtains 

lim — - = 0. (46) 
<5^o a{6) 

From the triangle inequality and inequalities (j35p . (j36p and ()4ip . one gets 

«('5)r5,aW II < WFivs) - fsW + \\Fivs) + a(<^)^;5 - fsW + a{6)\\vs - Vs,^^s)\\ 
< 026^ + 96 + 96. 



This inequality implies 



lima{6)\\Vs,ai5)\\ = 0- (48) 



The triangle inequality and inequality ()12p imply 

a\\Va\\ <a{\\Vs,a-Va\\ + \\Vs, 



< 6 + a\\Vs,a\\- ^^^^ 
From formulas (f39]) and (08]), one gets 

lim a(5) 1114(5) II =0. (50) 

It follows from Lemma [2] with fg = f, i.e., 6 = 0, that the function </>o(a) := o||^|| is 
nonnegative and strictly increasing on (0, oo). This and relation ()50|) imply 

lim a(5) = 0. (51) 

From the triangle inequality and inequalities (j4ip and (|12p one obtains 

1^5 - y|| < ||^^5 - Vs^a{5) II + \\V5,a{5) " || + \\Va(S) " y|| 

where V^(5) solves equation (3) with a = a{6) and fs = f- 

The conclusion (j37p follows from inequalities ()46p . ()5ip . (j52p and Lemma [TJ Theorem [7] 
is proved. □ 

Remark 5 Inequalities psp and (I36|) are used as stopping rules for finding approxima- 
tions: 

a{6) ^ a{6), and v{6) ^ 14,^(5) • 

Remark 6 By the monotonicity of F one gets 

\\F{u)-F{v)f < {F{u) - F{v), F{u) - F{v) + a{u - v)) 

<\\F{u) - F{v)\\\\F{u) - F{v) +a{u-v)\\, yu,v e H, Va > 0. 

This implies 

||F(n) - F(v)|| < ||F(n) - F(w) +a(n - ?;)||, yu,v (£ H, a > 0. (53) 
Fix 6 > and 6 > 0. Let C be as in Theorem [5l Choose Ci and C2 such that 

Ci(5^ + ^5 < C7,5^ < Ca*^^ - 06. (54) 
Suppose Oi and Vi, i = 1,2, satisfy condition (f35l) and 

lli^(^^i) - Ml < Ci6\ 026^ < \\Fiv2) - fs\\. (55) 
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Let us show that 

aiow ■= ai < a{5) < 02 := a«p, (56) 

where a{6) satisfies conditions of Theorem[5l Using inequality (f53]l for Vi and Vg^ai, ^ = l, 2, 
and inequality ([35]) . one gets 



\\Fivi) - FiVs,aM < \\Fivi)-FiVs,a,)+am-aiVs,o.^\\ 

< \\F{v^) + am - fsW < OS. ^ ^ 

From inequalities (I55p . ()57p and the triangle inequality, one derives: 

\\F{Vs,a,) - Ml < CiJT + 05 and C2<5^ - 96 < \\F{Vs,a,) - Ml- (58) 



Recall that ||-^(V5_a(5)) — /^H = C(^'^. Inequality is obtained from inequalities 
and the fact that the function (j){a) = \\F{Vs^a) — fs\\ is strictly increasing (see Lemma[2]). 

Let fs, FjCjOj'y, and 5 be as in Theorem [5] and El and Ci and C2 satisfy inequality 
(|54p . Let us formulate an algorithm (see Algorithm 1 below) for finding a{6) ~ a((5) 
and v{6) « V5 a{5), using the bisection method and assuming that F is a locally Lipschitz 
monotone operator and aiow and aup are known. By Theorem [71 v{5) can be considered 
as a stable solution to equation ([T]). 

Algorithm 1: Finding a{6) ~ a{6) and ~ Vs^a{5) given aiow ci^d aup- 

1. Let a := and uq be an initial guess for Vg^a- Compute n„ by formula ([32]) 
and stop at rigtop, where Ustop is the smallest n > for which condition (|35|) is 
satisfied. Then go to step 2. 

2. If 026'^ < \\F{unst^p) — fs\\, then set aup ■= a and go to step 4. Otherwise, go to 
step 3. 

3. If Ci6'^ < \\F{un^t„p) — fs\\, then stop the process and take v{6) := Uustop as a solution 
to If \\F{un,t^p) - fs\\ < Ci6'^, then set aiow ■= a and go to step 4. 

4. Check if ||a — ajoiu II is less than a desirable small value e > 0. If it is, then take 
v{6) := Un^t^p as a solution to ([T|). If is is not, then go back to step 1. 

Let us formulate algorithms for finding Oup and aiow 
Algorithm 2: Finding aup- 

1. Let a = a be an initial guess for a{6) and uq be an initial guess for v^. Compute 
Un by formula ([32l) with a and stop at Ustop-, the smallest n > for which condition 
([35|) is satisfied. Then go to step 2. 



2. If condition ([36]) holds for vs ■= Uustopi then stop the process and take Uustop as a 
solution to ([T|). Otherwise, go to step 3. 

3. If €26'^ < \\F{unstop) ~ fsWi then set Oup '■= a. Otherwise, set a := 2a and go back 
step 1. 

Algorithm 3: Finding aiow 
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1. Let a = a be an initial guess for a{6) and uq be an initial guess for vs- Compute 
Un by formula (|32p with a and stop at Ustop, the smallest n > for which condition 
(f35|) is satisfied. Then go to step 2. 

2. If condition ([36]) holds for vs ■= Un^t^^, then stop the process and take Un^t^p as a 
solution to ([I]). Otherwise, go to step 3. 

3. If \\F{un^t„p) ~ fs\\ < Ci5'^ , then set aiow '■= a. Otherwise, set a := ^ and go back 
step 1. 

In practice these algorithms are often implemented at the same time to avoid repetition 
calculations. 

Remark 7 The sequence (||n„ — a(5) ||)5^0' where n„ is computed by formula ([32|) and 
Vs^a{5) is the solution to ([3]) with a = a{5), is decreasing. Thus, the sequence Un will stay 
inside a ball B{0,R) assuming that i? > is chosen sufficiently large, so that y,UQ G 
B{0,R). 

Remark 8 Theorem [7] and the above algorithms are not only useful for solving nonlinear 
equations with monotone operators but also for solving linear equations with monotone 
operators. If one uses iterative methods to solve equation ([29]) then, by using Theorem [71 
one can stop iterations whenever inequality ()35l) holds. By using stopping rule (I35p one 
saves time of computations compared to solving (|29p exactly. If F is a positive matrix 
then one can solve (f29l) by conjugate gradient, or Jacobi, or Gauss-Seidel, or successive 
over-relaxation methods, with stopping rule (j35p . 

Remark 9 If F is twice Frechet differentiable, there are more options for solving equations 
([3]) and (i33]l : they can be solved by gradient-type methods, Newton-type methods, or a 
combination of these methods. 
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